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Abstract 

In order to obtain Markov heavy-traffic approximations for infinite-server queues with general 
non-exponential service-time distributions and general arrival processes, possibly with time- varying 
arrival rates, we establish heavy-traffic limits for two-parameter stochastic processes. We consider 
the random variables Q^{t,y) and Q^'{t,y) representing the number of customers in the system 
at time t that have elapsed service times less than or equal to time y, or residual service times 
strictly greater than y. We also consider W'^{t,y) representing the total amount of work in service 
time remaining to be done at time t + y for customers in the system at time t. The two-parameter 
stochastic-process limits in the space D{[0, oo),D) of D-valued functions in D draw on, and extend, 
previous heavy-traffic limits by Glynn and Whitt (1991), where the case of discrete service-time 
distributions was treated, and Krichagina and Puhalskii (1997), where it was shown that the vari- 
ability of service times is captured by the Kiefer process with second argument set equal to the 
service-time c.d.f. 



Keywords: infinite-server queues, heavy-traffic limits for queues, Markov approximations, two- 
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tral limit theorems, invariance principles, Kiefer process. 

1 Introduction 

One reason heavy-traffic limits for queueing systems are useful is that they show that non- 
Markov stochastic processes describing system performance can be approximated by Markov stochas- 
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tic processes under heavy loads. For a Markov process, it suffices to know the present state of that 
stochastic process in order to determine the distribution of the stochastic process at future times; 
we need no additional information from the past. With Markov approximations, that remains 
true approximately. In applications, the Markov property shows that the proper state has been 
identified and shows what needs to be measured in order to understand system performance. 

The classic example is the conventional heavy-traffic limit for the GI/GI/s queue, having s 
servers, unlimited waiting room, and independent and identically distributed (i.i.d.) service times 
independent of a renewal arrival process. The standard description of system state is the number 
of customers in the system at time t, which we will call the queue length and denote by Q{t). 
With non-exponential interarrival and service times, the stochastic process {Q{t) : t > 0} is not 
Markov. Then the future evolution at any time depends on the elapsed interarrival time and 
the elapsed service times of all customers being served. However, the conventional heavy-traffic 
limit, in which the traffic intensity approaches the critical value 1 from below while the number of 
servers remains fixed, shows that the queue-length process {Q{t) : t > 0} is approximately equal 
to a Markov process, in particular, reflected Brownian motion, under heavy loads |20l [2H [48 j . In 
fact, the interarrival times and service times need not come from independent sequences of i.i.d. 
random variables. Instead, it suffices to have the associated partial sums, or equivalently, the 
associated counting processes satisfy a FCLT. Moreover, the Markov property of the limit extends 
to conventional heavy-traffic limits for networks of queues |17j . 

The situation is very different for many-server heavy-traffic limits when the service-time distri- 
bution is non-exponential, either with s = oo or s — )• oo. In this paper, we will consider the case 
in which s = oo, i.e., the G/GI /oo model with i.i.d. service times independent of a general arrival 
process, where heavy traffic is achieved by letting A — )• oo, while the service-time distribution is 
held fixed. However, the problem is relevant more generally with many servers, where s — )• oo as 
A — )• oo with s — X = 0(\/A), as in [16j. For infinite-server models, we index the stochastic processes 
by the arrival rate A. We are interested in the infinite-server model both for its own sake and as 
an approximation for many-server queues. In fact, heavy-traffic limits for infinite-server models 
can play a role in characterizing the heavy-traffic limits for corresponding many-server models, as 
shown by Reed [Ml SO] and [Ml EE] • 

With infinitely many exponential servers, we again obtain Markov diffusion limits, as first shown 
by Iglehart [18] for the M/M /oo model; see [36] for a review. A systematic way to extend the limit 
to general arrival processes is given in §7.3 of f36]. However, with non-exponential service times, the 
established heavy-traffic limit for Q{t) is not Markov. As first shown by Borovkov [3J, and further 



2 



discussed in [191 [HI [301 [TH [27] , the limit process is Gaussian, which imphes that the distribution 
of Q{t) itself is approximately normal, but the limiting Gaussian stochastic process is non-Markov, 
unless the service times are exponential (plus a minor additional case, |13[ I27j). 

We consider a stochastic process characterizing the system state for which the associated heavy- 
traffic limit process is Markov. We do so in two ways: First, we consider the two-parameter 
stochastic process {Q^{t,y) ■ t > 0,y > 0}, where Q^{t,y) represents the number of customers 
in the system at time t with elapsed service times less than or equal to time y. We do not pay 
attention to specific customers or servers but only count the total numbers. The random quantity 
Q'^{t,y) is an observable quantity given the system history up to time t. We recommend that the 
stochastic process '■ t > 0,y > 0} he used in models and measured in practice. Ways to 

exploit such ages for control are discussed in [9j. 

So far, we have used elapsed service times, because they are directly observable. We can equally 
well work with residual service times, and consider the process Q'^{t,y) counting the number of 
customers in the system at time t with residual service times strictly greater than y. With i.i.d. 
service times having c.d.f. F, we can go from one formulation to the other. If the elapsed service 
time is y, then the residual service time has distribution Fy{x) = F{x + y)/F^{y) for x > 0, where 
P'^iu) = 1 — F{y)- If the service times are learned when service begins, then both Q^{t,y) and 
Q'^{t,y) are directly observable. Otherwise, elapsed service times correspond to what we observe, 
while residual service times represent the future load, whose distribution we may want to describe. 

We regard {Q^{t,-) : t > 0} and {Q'^{t,-) : t > 0} as function-valued stochastic processes, 
in particular, random elements of the function space Dd; see §2.31 Since the functions Q^{t,y) 
{Q^(t, y)) are nondecreasing (nonincreasing) in y, we can also regard Q'^{t, ■) and Q' ■) as measure- 
valued processes, but we will work in the framework Dq. 

For the M/ GI/oo model, it is easy to see that the stochastic process •) : t > 0} is a Markov 

process; |10[ I33j (where references to earlier work are given). The key idea, expressed in the proof 
of Theorem 1 of |10j . is a Poisson-random-measure representation. For the more general GI/GI /oo 
model, having a non-Poisson renewal arrival process, the stochastic process {Q^{t, •) : t > 0} is 
in general not Markov from that perspective, because the future evolution also depends on the 
elapsed interarrival time. The Markov property is violated more severely when the arrival process 
is not renewal. However, just as for the G/GI/s model discussed above, the heavy-traffic limit 
for the arrival process typically does have independent increments, so this non-Markovian aspect 
disappears in the heavy-traffic limit. In the limit, Q^{t, y) for the G/GI /oo model is asymptotically 
equivalent to what it would be in the corresponding M/GI /oo model, except for a constant factor 
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to account for the different variance; see Theorem 14.21 and Corollaries 14.11 and l4.2[ 

Proof Strategy. Our proof builds on previous work by Glynn and Whitt [14j and Krichagina 
and Puhalskii [27J. First, a restricted form of the desired two-parameter stochastic-process limit 
was already established in Theorem 3 of [14j for the case of service-time distributions with finite 
support. That result is only stated in D for arbitrary fixed second parameter y, but it can be 
extended quite easily to the function space Dd. Since distributions with finite support are dense 
in the space of all probability distributions, one might consider the matter settled. However, much 
depends on the precise assumptions made about the service-time distribution. The goal should be 
to treat general service-time distributions without any extra conditions. We should not need to 
assume that any moments are finite or that the c.d.f. is continuous or absolutely continuous. 

One important feature of [27] is that they treat completely general service-time distributions. 
However, they do not state limits for two-parameter queueing processes. It might seem that it should 
be a routine extension to do so, but we show that is not so, because a candidate limit process is not 
a random element of the space Dd for discontinuous service-time c.d.f.'s, as we explain in Remark 
13. 3[ Fortunately, however, the argument in [27] can be extended to the two-parameter case if we 
restrict attention to continuous service-time c.d.f.'s, which we do. 

A key idea in [14] is to treat service-time distributions with finite support by representing 
them as finite mixtures of deterministic service-time c.d.f.'s, and then split the arrival process 
into corresponding arrival processes associated with each deterministic service time; see §3 of |14j . 
especially. Proposition 3.1. That step relies on the FCLT for split counting processes, as in §9.5 of 
[38]. The mixture argument extends quite directly to treat arbitrary discrete distributions. It also 
extends to arbitrary distributions if we can treat continuous service-time c.d.f.'s, but the proof in 
|14j does not seem to extend naturally to continuous service-time c.d.f.'s. 

Hence, for the final case of a continuous service-time c.d.f., we draw heavily on [27J. Our limits 
for continuous service-time c.d.f.'s are extensions of theirs, obtained using the same function space 
and the same martingale arguments. The proof in [27J already took a two-parameter approach and, 
following Louchard [30], showed that it is fruitful to view the service times through the associated 
sequential empirical process (in (j2.3p below). They showed that a scaled version of the sequential 
empirical process converges to the two-parameter standard Kiefer process, with the service time 
c.d.f. in the second argument (see (j2.6p below). This convergence was established in the space Dd; 
see 
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Other Related Literature. As noted in [27j, the relevance of the two-parameter Kiefer process 
for the infinite-server queue was first observed by Louchard |30j . The results here were briefly 
outlined in §6.4 in our survey [36j . (The first drafts of this paper were written at that time.) 
Related fluid limits for measure- valued processes have since been obtained in [25 1 123 1 [53]. However, 
the first fiuid limit for two-parameter processes for this model evidently was the fluid limit in §6 
of [l9] for the discrete-time version of that more general Gt{n)/GI/s + GI model, having both 
time-dependent and state-dependent arrivals. Decreusefond and Moyal [8] established a FCLT for 
the M/GI/oo model. In contemporaneous work. Reed and Talreja [H] extend the result in [8j to 
the G/GI /oo model and show that the limit process Q'^ can be regarded as an infinite-dimensional 
(distribution-valued) OU process, thus proving that the limit process {Q'^(t, •) : t > 0} is a Markov 
process. In these other papers, like [14J, there are extra regularity conditions on the service-time 
c.d.f. Moreover, the alternative spaces admit fewer continuous functions. 

Organization of this paper. We start with preliminaries in 321 In fJ3]we state our main results, 
focusing only on new arrivals (ignoring any customers initially in the system). In ^we characterize 
the limit processes. In ^ we treat the initial conditions, and treat all customers in the system. 
In ^ we prove the main theorem: Theorem 13.21 focusing on the case of continuous service-time 
distribution. In ^6.11 we prove the continuity of the representation of some key processes in the 
space Dd. In ^6.21 we continue the proof by establishing tightness of the key processes. In ^6.31 
we complete the proof by establishing convergence of the finite-dimensional distributions. There 
is also a longer version of the present paper {37j available from the authors' web sites. It has a 
longer introduction; it shows how known results for the special case of exponential service times can 
be derived from our formulas; it presents supporting technical details, including basic facts about 
the Brownian sheet, the Kiefer process, two-parameter stochastic integrals, tightness criteria in the 
space Df) and some detailed calculations. 

2 Preliminaries 

2.1 Initial Conditions and Assumptions 

It is convenient to treat the congestion experienced by customers initially in the system separately 
from the congestion experienced by new arrivals, because they usually can be regarded as being 
asymptotically independent. Thus we first focus only on new arrivals and then later treat the initial 
conditions in ^ 
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Assumptions for the Arrival Processes. We consider a sequence of G / GI /oo queues indexed 
by n, where the arrival rate is increasing in n. For the rfi^ system, let An{t) be the number of 
arrivals by time t and r" the time of the i^^ arrival. 

We assume that the sequence of arrival processes satisfy a FCLT, specified below. All single- 
parameter continuous-time stochastic processes are assumed to be random elements of the function 
space D = Z)([0, oo),M) with the usual Skorohod Ji topology [21 US]. Convergence — )• x as 
n — 7- cxD in the Ji topology is equivalent to uniform convergence on compact subsets (u.o.c.) when 
the limit function x is continuous. Throughout, we will have a bar, as in An{t), to denote the law 
of large number (LLN) scaling (as in (12.21) below) and a hat, as in A„(t), to denote the central limit 
theorem (CLT) scaling (as in (j2.ip below). 

Assumption 1: FCLT. There exist: (i) a continuous nondecreasing deterministic real-valued 
function a on [0, oo) with a(0) = and (ii) a stochastic process A m. D with continuous sample 
paths, such that 

An{t) = n~^/'^{An{t) -na{t)) ^ A{t) in D as n ^ oo. ■ (2.1) 

As an immediate consequence of Assumption 1, we have an associated functional weak law of 
large numbers (FWLLN) 

A it) 

An{t) = ^ a(t) in D as n ^ oo. (2.2) 

n 

In order to obtain a limiting Markov process we will also assume that the limiting stochastic process 
A has independent increments, but we will obtain limits more generally. 

The Standard Case. The standard case in Assumption 1 has special a and A. For the FWLLN 
limit, the standard case is a{t) = Xt,t > for some positive constant A, which corresponds to an 
arrival rate of A„ = An in the n^^ system, but our more general form allows for time-varying arrival 
rates as in [33| [32] . 

For the FCLT limit A, the standard case is BM. That occurs when the arrival processes are 
scaled versions of a common renewal process with interarrival times having mean A^^ and SCV c^. 
Then A{t) = ^/X^Ba{t), where B a is a standard BM. Of course, the convergence to BM in (j2.ip 
holds much more generally, e.g., see Chapter 4 of [48j. Except for the SCV c^, in the standard case 
Assumption 1 makes the arrival process asymptotically equivalent to a Poisson process. Thus, in 
the standard case, the limiting results will be identical to the limit for the M/GI /co model when 
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= 1, and very similar for 7^ 1. Actually, there is an important structural difference when 
7^ 1, which we discuss in ^ 

Assumptions for the Service Times and the Empirical Process. 

Assumption 2: a sequence of i.i.d. random variables. We assume that the service times 
of new arrivals come from a sequence of i.i.d. nonnegative random variables {rji : i > 1} with a 
general c.d.f. F, independent of n and the arrival processes. ■ 

As in |27j, it is significant that our queue-length heavy-traffic limits over finite time intervals 
do not require more assumptions about the service-time c.d.f. F. It need not have a finite mean. 
However, for subsequent results we will need to assume in addition that F has a finite mean /i^^ 
and even a finite second moment with SCV c^. 

Krichagina and Puhalskii [27] observed that it is fruitful to view the service times through the 
two-parameter sequential empirical process 

1 

Kn{t,x) = -y^l{r]i<x), t>0, x>0, (2.3) 

i=l 

which is directly expressed in the LLN scaling. Here l(^) is the indicator function. Since the 
service times are i.i.d. (without any imposed moment conditions), we have a FWLLN for Kn itself 
and a FCLT for the scaled process 

1 

knit, x) = MKnit, x) - E[Kn{t, x)]) = -= V(l(r/. < x) - F(x)), (2.4) 
for t > and x > 0. 

These stochastic-process limits are based on corresponding limits in the case of random variables 
uniformly distributed on [0,1]. Let Un{t,x) denote the stochastic process Kn{t,x) when r]i is 
uniformly distributed on [0, 1], so that F(x) = x, < x < 1. Extending previous results by Bickel 
and Wichura [Ij, Krichagina and Puhalskii [27) showed that 

Un{t,x) ^U{t,x) in D([0,oo),Z)([0,l],M)) as n ^ 00, (2.5) 

where U{t,x) is the standard Kiefer process; see Csorgo and Revesz [7], Gaenssler and Stute [T^ . 
and van der Vaart and Wellner [l5]. In particular, U{t,x) = W{t,x) — xW{t, 1), where W{t,x) is 
a two-parameter BM (Brownian sheet), so that U{-,x) is a BM for each fixed x, while U{t, ■) is a 
Brownian bridge for each fixed t. The Brownian bridge can be defined in terms of a standard 
BM B by S°(t) = B{t) - tB{l), < i < 1; it corresponds to BM conditional on having B{1) = 0. 
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It is significant that K„ can be expressed as a simple composition of Un with the c.d.f. F in 
the second component. We thus have 

kn{t,x) = Un{t,F{x)) ^ K{t,x) = U{t,F{x)) in Z)([0, oo), D([0, oo), R)), (2.6) 

as n — 7- oo without imposing any conditions upon F, because F is not dependent on n. Moreover, the 
convergence is with respect to a stronger topology on Dd = ^([O, oo), D([0, oo), M)); convergence 
is uniform over sets of the form [0,T] x [0,oo); we have uniformity over [0, oo) in the second 
argument. That will turn out to be important when we treat the remaining-workload process. As 
a consequence of the FCLT in ()2.6p . we immediately obtain the associated FWLLN 

Kn{t, x) ^ k{t, x) = tF{x) in Do as n — )• oo, (2.7) 

where again there is uniformity in x over [0,oo). 

2.2 Prelimit Processes 

Let Qf^{t,y) represent the number of customers in the n}^ queueing system at time t that have 
elapsed service times less than or equal to y; let Q'^{t,y) represent the corresponding number that 
have residual service times strictly greater than y. Let Qn{t) represent the total number (the 
superscript t) of customers in the n^^ queueing system at time t. Clearly, Qn{t) = Qn{t,t) = 
Q'n{t,0), and 

Qnit,y) = Qn{t + y,t + y)-Qn{t + y,y) = Qiit + y)-Qn{t + y,y), 

QUt,y) = Ql{t,d)-Q'n{t-y.y) = Qi{t)-Qn{t-y.y)- (2-8) 

From (j2.8p . it is evident that we can construct all three processes Q^, Qn and from either 

or Observe that Q^^ and can be expressed as 

A„{t) 

Qnit^y) = 5^ l(rr + r/. >t + y), t>0, y>0, (2.9) 

i=l 

An{t) 

Qnit,y) = Yl Hrr + vi>t), t>0, 0<y<t. 

i=An{t-y) 

From (j2.9p . we see the connection to the sequential empirical process Kn in ()2.3p . Indeed, the 
key observation (following [27]) is that we can rewrite the random sums in (|2.9p as integrals with 
respect to the random field Kn by 

ft f'OC 

Qlit.y) = n l{s + x>t + y)dKn{An{s),x), t,y>0, (2.10) 

Jo Jo 

Qnit,y) = n[ I l{s + X>t)dKn{An{s),x), t > 0, < y < 
Jt-y Jo 
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for Kfi in ()2.3p . These two-dimensional integrals in ()2.10p are two-dimensional Stieltjes integrals. 
In the present context, the integrals in p.lOp are understood to be (defined as) the random sums 
in ([23]). 

Lemma 2.1 (representation of and Q^,) The processes Ql^ and defined in ()2.9p and ()2.10p 

can he represented as 

Q:,{t, y)=n f F\t + y-s) da{s) + V^iK,iit, y) + Xl^{t, y)), t, y > 0, (2.11) 
Q^(t,y) = n r F^(t-s)da(s) + V^(X^,i(t,y) + X^,2(i,y))> * > 0, < y < t, (2.12) 

Jt-y 

where 

rt rt 



Xl^{t,y)= f F^{t + y-s)dAn{s), Xl^{t,y) = [ F^(t - s) di„(s), (2.13) 

Jo Jt~y 

/"OO f't f'OO 

K,2it,y)= / Hs + x>t + y)dRn{s,x) = - / l{s + x<t + y)dRn{s,x), (2.14) 
Jo Jo Jo Jo 

K,2{t^y)^ [ f l{s + x>t)dRn{s,x) = - I [ l{s + x<t)dRn{s,x), (2.15) 

Jt-y Jo Jt-y Jo 

Rnit,y) = kn{An{t),y) = ^y] (l(^?^ < y) - Fiy)) (2.16) 
= ^Kn{An{t),y) - An{t)F{y) - ^a{t)F{y), 

with the integrals in (j2.13p . (j2.14p and (j2.15p all defined as Stieltjes integrals for functions of bounded 
variation as integrators. 

Proof. Apply ()2.4p to get the first relation in (j2.16p . (Right away, from (j2.6p . we see that 
Rn{t,x) =^ k{a{t),x).) Use ([23]) and (^3^ to get the rest of (f236|l and 

1 

i^„(^(t),x) = - V 1(??, < x) 
n ^-^ 

i=l 
1 1 



V (l(r/i < x) - F{x)) + —V^{An{t) - a{t))F{x) + a{t)F{x) 



= -^Rn{t,x) + ^An{t)F{x) + a{t)F{x). (2.17) 

Combine (j2.1Up and (j2.17p to get (j2.1ip . The alternative representation for Xn,2{t, y) holds because 
Kn{t, oo) = and thus Rnit, oo) = for all t. ■ 
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We will also consider several related processes. Let F^{t, •) and FJ^{t, •) represent the empirical 
age distribution and the empirical residual distribution at time t in the n*^ system, respectively, 
i.e., 

F^{t,y) = Qf,{t,y)/Qi{t), t>0, < y < t, (2.18) 

and 

F;''=(t,y) = l-F;(t,y) = Q;(t,2/)/Q^(t), t > 0, y > 0. (2.19) 

For each n and t, F^{t, •) and F^{t, •) are proper c.d.f.'s. Let Dn{t) count the number of departures 
in the interval [0,t]; clearly, Dn{t) = An{t) - Q\^{t) for t > 0. 

We will also consider several processes characterizing the workload in total service time. For 
these limits, we will assume that we are in the standard case for the arrival process and impose 
extra moment conditions on the service-time c.d.f. F. The total input of work over [0, t] is 

In{t)=Y,V^, t> 0. (2.20) 

1=1 

The amount of the workload to have arrived by time t that will be remaining after time t + y is 

W:{t,y)^ Ql{t,x)dx, t>0, y>0. (2.21) 

Then the total (remaining) workload at time t is W^{t) = W^{t,0). Finally, the total amount of 
completed service work by time t is C„(t) = /„(t) - W^{t). 

2.3 The Space Do 

Our limits for two-parameter processes will be in the space Do, which we regard as a subset of 
L'([0, oo), D([0, oo), M)), where D = L'([0, oo), S*), for a separable metric space S, is the space of 
all right-continuous S- valued functions with left limits in (0, oo); see [21 148] for background. We 
will be considering the subset of functions x{t, y) which have finite limits as the second argument 
y — )• oo. For example, we have Qn{t, y) = Qn(t, t) for all y > t and Q^it, y) — )• as y — )• oo. We will 
be using the standard Skorohod [42j Ji topology on all D spaces, but since all limit processes will 
have continuous sample paths, convergence in our space is equivalent to uniform convergence 
over subsets of the form [0, T] x [0,oo). (We already observed that we have such stronger uniform 
convergence over that non-compact set for Kn to the Kiefer process in ()2.5p .) We refer to [44] for 
the convergence preservation of various functions in Du. 

For two-parameter processes, one might consider using generalizations of the spaces of two- 
parameter real- valued functions considered by Straf [43] and Neuhaus |35j , but those spaces require 
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limits to exist at each point in the domain (subset of M?) through ah paths lying in each of the 
four quadrants centered at that point. That works fine for the sequential empirical process Kn, 
but not for Ql^{t,y). For example, suppose that the first two arrivals occur at times 1 and 3, and 
that the arrival at time 1 has a service time of 2. Then limits do not exist along all paths in the 
southeast and northwest quadrants at the point {t,y) = (2,1), because there are discontinuities 
along a negative 45° line running through that point. The value shifts from to 1 at that line. 
However, there is no difficulty in the larger space Dd. 

2.4 The Service-Time Distribution as a Mixture 

The general service-time c.d.f. F has at most countably many discontinuity points. Let pd (pc) be 
the total probability mass at the discontinuity (continuity) points, i.e., pd = Ylx>o ^^i^) — ^ 
Pc = 1 — Pd 1^ where AF{x) = F{x) — F{x—). To focus on the interesting case, suppose that 
< Pd < 1- We order the discontinuity points by the size of their probability mass in decreasing 
order (using the natural order in case of ties); i.e., let {xi,X2, ■■■} be such that AF{xi) > AF{xi-^-i). 
Define two proper c.d.f. 's Fc and Fd for a continuous random variable tj'^ and a discrete random 
variable rj'^, respectively, by 

FJx) = Pir]" <x) = — (f(x) - V AF(y)) , x>0, 

y<x 

and 

Fd{x)^ V ^(7?^^ = %), and prf,,^P(r?'^ = x,) = ^^, x > 0. 
.r-^ Pd 

Note that F can be represented as the mixture F = PcFc + PdFd- 

Let A'^{t), A'^{t) and A'^^{t) count the number of arrivals by time t with continuous service 
time, with a discrete service time, and with a deterministic service time Xj, i = 1, 2, respectively. 
Clearly, Ai{t) = Xl^i ^n,i(*) and An{t) = Ai{t) + A^^it) for t > 0. Define the LLN-scaled processes 

4C — „ — 1 AC Ad — „ — 1 Ad „„ J Ad — „-l Ad 

~ ^ yi„ — n ana Ji^^- — n /i^ j. 

Under Assumptions 1 and 2, for a general service-time c.d.f., we can decompose the system into 
two subsystems, one with arrival processes A'^ and service-time distribution Fc and the other with 
arrival processes A'j^ and discrete service times {xi : i > 1} with distribution Fd- We will adopt the 
method in [27] to analyze the first subsystem in the space Do, then the method in [14] to analyze 
the second subsystem, and then we put them together to obtain the limits for the whole system. 
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3 Main Results 



In this section, we state the main results of this paper: the FWLLN and FCLT for the scaled 
processes associated with QJ^ and W^, along with the closely related processes. We give the proofs 
in ^ Define the LLN-scaled processes QJ^ = > 0, y > 0} by 

Qnit,y)^^^, (3.1) 

and similarly for the processes Q^, Qn, Dn, W^, W^, In and Cn- Define the LLN-scaled processes 
F^i = {F-{t, y),t> 0,0 <y<t} and K'' = {Fj^'^it, y),t>0,y> 0} by 

Kit, y) = Q^(i, y)/Qi{t) and FJ^'^t, y) = Q^Xt, y)/Qi{t), (3.2) 

where F^{t,y) and Fn'^{t,y) are defined to be if Qn{t) = for some t. By Lemma [2711 

Q';,it,y)= [ F''{t + y-s)dais) + ^{Xn,i{t,y)+Xn,2{t,y)), t,y>0. (3.3) 

Jo VlT- 

When we focus on the amount of work, as in the workload processes, we use the stationary- 
excess (or residual-lifetime) c.d.f. associated with the service-time c.d.f. F (assumed to have finite 
mean //~^), defined by 

Fe{x) = fj. F''{s)ds, x>0. (3.4) 
Jo 

The mean of Fg is E[r]'^]/2E[r]] = (c^ + l)/2;u; that will be used in part (c) of Theorem 13.11 below. 

Theorem 3.1 (FWLLN) 

(a) Under Assumptions 1 and 2, 

^ni ^ri' ^ri' {^n,j • ^ — l}i On' Qn, Qn, ^n, K' , ^n 

a, {df:t> 1}, k, <f,q\ f, f', f d) (3.5) 



in X D°° X Djj x D x Djj x D as n — )• oo w.p.l, where the limits are deterministic functions: 
a is the limit in (|2.2p . a'^ = pcCL, af^ = p^a, af = Pd,id'^, for i > 1, k{t,x) = tF{x) in (|2.7p . 



f{t,y) = [ F^(t + y-s)da(s), t > 0, y>0, (3.6) 
Jo 

f{t,y) = [ F^^t - s)dd{s), t>0, 0<y<t, (3.7) 

Jt-y 

q\t)^<rit,0)=fit,t), nt,y)^fit,y)/q\t), F'^t^y) ^ q'it,y)/q\t) and d = d - qK 



12 



(b) If, in addition to the assumptions in part (a), a{t) = Xt, t > 0, and the service-time c.d.f. 
F has finite mean fi^^ , then 

[W^,W^,In,Cn)^{w'~,w\l,c) in DdX.D'^ as n oo w.p.l, (3.8) 

jointly with the limits in (|3.5p . where 

/•oo 

w''{t,y) = X f{t,x)dx, t>0, y>0, 
Jy 

= X [ ( [ F^{t + X - s)ds) dx = - [ F^{y + s)ds, 



A 



w\t) = w\t,^) = - / F^{s)ds, 
A* Jo 

Xt - - A /"* 

i{t) = — and c{t) = i{t) - w* {t) = - Fe{s)ds, (3.9) 

A* Jo 

for Fe in (l3:iD . 

(c) //, m addition to the assumptions of parts (a) and {h), Elrf] < oo, then 

A /"°° Afr^ -I- 1 1 

w'^(t,y) - / F,"(y + s)ds < oo and w\t) ^ ' ' as t ^ oo. (3.10) 
7o 

We obtain Theorem 13.11 as an immediate corollary to the following FCLT, which exploits cen- 
tering by the deterministic limits above. For the FCLT, define the normalized processes 

Qnit, y) = V^iQnit, y) - cfit, y)), (3.11) 

for t > and y > 0, and similarly for the other processes, using the centering terms above. By 
(I33D and (IMI), 

g;(t,y) =X;i(t,y) + X;2(i,y), t>0, y>0. (3.12) 

Moreover, 

F:^%t,y) ^ V^(F;''=(t,y)-f'^(t,y)) 

= Qiit)-'{Qnit,y)-Qiit)nt,y)), t>0, y>0, 

and 

K{t,y) ^ V^{K{t,y) - f-{t,y)) 

= Qi{tr\Qn{t,y)-QrXt)r{t,y)), t>o, 0<y<t. 

Define the CLT-scaled processes = {i^(t) : t > 0}, = {Af^{t) : t > 0} and i^^^ = 
{Al,{t) : t > 0} by 

i^(i) = n'/\AUt) - m), Aiit) = n'/\At{t) - At)), A^t) = n'/\Aijt) - At)), 
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for t > and i > 1. 

The joint deterministic limits in Theorem 13.11 are equivalent to the separate one-dimensional 
limits, but that is not true for the FCLT generalization below. Let o be the composition function, 
i.e., (x o y){t) = x(y{t)), t > 0. Let = mean equality in distribution. 

Theorem 3.2 (FCLT) 

(a) Under Assumptions 1 and 2, 

{Aji, Aj^, j4„, j : i > 1}, Qn^ Qm Qm ) ^ri) 

(i, i^ A", {Af:z> 1},K, Q\Q\ Q^ F^ D) (3.13) 
in X D°° X Djj x D x x D as n ^ oo, where A is the limit in (j2.ip . 

A" = pcA + S'^oa, A"^ = pdA + S'^ o a, Af = pdPd,iA + Sf o a, 



Sf = ^PdPd,i{'^-PdPd,i)B, i>l, (3.14) 

where B is a standard BM, independent of A, and the process {S'^, S'^, {Sf : i > 1}) is an infinite- 
dimensional BM with mean and covariance matrix C where Cc,c = Pc(l —Pc), C^^d = Pd(l ~ Pd); 
Cc,d = Cd,c = -PcPd, Ci,i = PdPd,i{'^ -PdPd,i) for i > I, Ci^c = Cc,i = -PcPdPd,i, Ci^d = Cd,i = 
—PdPd,! o,nd Cij = —PdPd,iPd.j for i ^ j, and the representations for and are 

Q'{t,y) = Xl^\t,y)+XY{t,y) + X''^''\t,y), t > 0, y > 0, (3.15) 
Q^(t,y) = X'^''{t,y) + Xl^\t,y) + X^^^{t,y), t > 0, < y < t, 

where 

Xrit,y) ^ f F-^{t + y-s)dA'^{sl X^'^it^y) ^ [' F^it - s)dA'^is), (3.16) 

Jo Jt-y 
f't roc 

X2'"{t,y) = / / lis + x>t + y)dk'{a'{s),x), 
Jo Jo 

X'/{t,y) = I [ l{s + x>t)dK''ia^{s),x), 

Jt-y Jo 
oo 

X'''^{t,y) = ^(Af{t)-Af{t-{x.-y)-^)), 

i=l 

oo 

X''^^{t,y) = Y.(Af{t)-Af{t-{x,Ay))), 

i=l 

withK%a%s),x) = U{a''{s), F^{x)), which is independent of A. Q\t) = Q'"it,0), Q%t,y) = Q\t)- 
Q'\t-y,y), F-'%t,y) = qHtrHQ''it,y)-Q'{t)f''%t,y)), F%t,y) = q'{trHQ%t,y)-Q'{t)f^{t,y)), 
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and D = A — . All these limit processes are continuous. If, in addition, A = Ba o a, as when An 
is nonhomogeneous Poisson, then A'^ and A'^ are independent, and thus Xl'^ , X2'" and X^'*" are 
mutually independent. 

(b) If, in addition to the assumptions in part (a), a{t) = Xt, t > 0, and the service-time c.d.f. 
F has finite mean fi^^ , then {W^,Wn) =^ {W'^,W^) in Dd x D as n — )• cxd jointly with the limits 
in (j3.13|) . where 

W'"{t,y)= Q'\t,x)dx, and W\t) = W'{t,{^) = Q''{t,x)dx. (3.17) 



(c) If, in addition to the assumptions in parts (a) and (b), E[ri'^] < 00, then (in,Cn) =^ (i^C) 
in as n ^ CO jointly with the limits above, where 



I{t) = VAc25,(t) + ^-^A and C{t) = I{t) - W\t), t > 0, (3.18) 
with Bs being a standard BM independent of A. 

Remark 3.1 The limit processes and can also be expressed as the sum of the following 
three mutually independent processes 

Q''{t,y) = X{it,y)+X^''-{t,y) + Xlit,y), t>0, y>0, (3.19) 
Q'{t,y) = Xt{t,y)+X'/{t,y) + XI{t,y), t>0, 0<y<t, 



where 



X';it,y)= [ F^{t + y-s)dA{s), X',{t,y) ^ [ F^{t - s)dA{s), (3.20) 

Jo Jt-y 
ft 00 

Xl{t,y) = / F^{t + y-s)dS'^{a{s))+Y,{St{m-St{a{t-{x,-y)^))), 
F^{t - s)dS^{a{s)) + ^ {Sfm) - St{a{t - {x, A y)))) . 

-y i=i 

The asymptotic variability of the arrival process is captured by A, which appears only in X[ and 
Xf; the asymptotic variability of the service process is captured by K"^, which appears only in 
X2'^ and X2^; while the asymptotic variability of service-time splitting is captured by S'^ and S'f , 
which appears only in X"^ and X^. Thus, in some sense, there is additivity of stochastic effects, as 
pointed out in |30^ 127]. but this might be misinterpreted. Notice that both X[ and X2 depend on 
the full service-time c.d.f. -F, not just its mean. On the other hand, the arrival process beyond its 
deterministic rate only appears in X'[ and Xf, so that there is a genuine asymptotic insensitivity 

2'^ and X2' 



to the arrival process beyond its rate in ^2'^ and ^2'^ 



15 



This claim holds because, by (|3.14p . we can write Xi{t,y) and X'^{t,y) in (jS.lSp as 

X'/{t,y) = f F^{t + y-s)d{p,A{t) + S%a{s))) 
Jo 

= HF^it + y-s)- Yl AFiu))d{Ait)+p-'S%ais))), 

■^0 u>t+y-s 

and 

oo 

= [pdPdAMt) - A{t - (x, - y)+))) + (5f(a(t)) - Sf{d{t - (x, - y)+))) 

i=l 

ft °° 

= { Y mn))dA{t) + Y{St{d{t))-St{-a{t-{x,-y)+))), 

•^0 u>t+y-s 1=1 

which implies that X^'''{t,y) + X'^''''{t,y) = X{{t,y) + Xl{t,y) for each t > and y > 0. Similarly, 
Xl^^t, y) + y) = If (t, y) + y) holds. . 

Remark 3.2 The two integrals in the expression for Q^' are stochastic integrals. The first integral 
for X^'^ (or is a standard Ito integral if A is a (time-changed) Brownian motion; otherwise, 
the expression for X'^'^' (or X[) is interpreted as the form after integration by parts. The relevant 
version of integration by parts for XJ^ and X[ is given in Bremaud [4J, p. 336. For j^, it yields 

X;i(t, y) = F^{y)An{t) - f i„(s-) dF{t + y-s), (3.21) 

Jo 

and similarly for Xi. The left limit An{s—) in ()3.2ip is only needed if the functions F and An have 
common discontinuities with positive probability. The second integral for X2 is either understood 
as the stochastic integrals with respect to two-parameter processes of the first type, or in the 
mean-square sense, as in f2^; see ^6.31 

In the literature, several types of stochastic integrals with respect to two-parameter processes 
have been defined. The first type of integral was first defined for two-parameter Brownian sheets 
by Cairoli [5] (see also |46)). generalizing the definition of Ito's integral directly. It was generalized 
to n-parameter Brownian sheets by Wong and Zakai [51] and to general martingales by Cairoli and 
Walsh [6]. Even more generalization appears in Wong and Zakai |52j . We refer to Koshnevisan |26j 
for a relatively complete review. The important property we apply here is the isometry property, 
analogous to the Ito isometry property. ■ 

Remark 3.3 We remark that if the service-time c.d.f. F is discontinuous, the process X2 defined 
by 

poo 

X2{t,y)= I I l{s + x>t + y)dk{a{s),x) 
Jo Jo 
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is only continuous in t, but not in y, and in fact, it is not even in the space The continuity of 
X2 and in t can be obtained as in Lemma 5.1 of [27] , To see that X2 need not be in Dd, suppose 
that F is the mixture of two point masses yi > and 2/2 > 0. Then, applying (|4.ip below, we see 
that, for each t > 0, X2{t, y) = for all y > except yi and y2, so that X2{t, •) ^ D. That property 
follows from (|4.ip because A^{ti,t2, xi, X2) = for < xi < X2 unless either yi < xi < y2 or 
xi < yi < X2 < y2- That means that the random measure attaches all mass on the strips x = yi 
and X = 2/2- Incidentally, in this example, X2{t, •) is an element of the space E in Chapter 15 of 
|48j . That explains why we split the general distribution into a mixture of a discrete distribution 
and a continuous distribution. ■ 

We now establish additional results in the standard case for the fluid limits. In particular, we will 
obtain an analog of the classic result for the M/GI / 00 model, stating that in steady state both the 
elapsed service times and the residual service times are distributed as mutually independent random 
variables, each with c.d.f. Fg in (j3.4p . We will see that the limiting empirical age distribution is 
precisely Fg, just as is true for the prelimit processes with a Poisson arrival process. 

Corollary 3.1 (the standard case) Consider the standard case in which a{t) = Xt, t > 0, and 
A = Xc^Ba, where Ba is a standard BM. Assume that the service-time distribution F has finite 
mean fi^^ . Under Assumptions 1 and 2, the limits in (13. 5p hold with 

fit, y) = X I F^{t + y-s)ds = X [ F%y + s) ds 
Jo Jo 

[X/fi] F^{y) as i 00, 
(f{t,y) = a/* F''{t-s)ds = X r F'{s)ds = {X/fi)Fe{y), for t>0, 

Jt~y Jo 

r{t,y) = f{t,y)/q\t)^Fe{y) as t ^ 00, 
r'%t,y) = f{t,y)/q\t)^F^{y) as t ^ oc. (3.22) 

4 Characterizing the Limit Processes 

We now show that the two-parameter queue-length limit processes, Q^{t,y) and Q'^{t,y), consti- 
tute continuous Brownian analogs of the Poisson-random-measure representation for the M/GI/ 00 
model [To]. (But the limit is only identical to the limit for the M/GI/00 model when = 1.) 
A key role here is played by the transformed Kiefer process K{t,x) = U{t,F{x)) = W{t,F{x)) — 
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F{x)W{t, 1). Any finite number of iiT-increments, 

A^{ti,t2,Xi,X2) = Kit2,X2)-K{t2,Xi)-k{ti,X2) + Kiti,Xi) (4.1) 

= Aw{ti,t2,F{x^),F{x2)) - {F{x2) - F{xi)){W{t2, 1) - W{h, 1)) 

for < ti < ^2 and < xi < X2, are independent random variables provided that the rectangles 
{ti,t2] X {xi,X2] have disjoint horizontal time intervals (^1,^2]- 

We only treat here. If the limit process A has independent increments, then so does , 
provided that it is viewed as a function- valued process with the argument t. The limit processes 

is then a Markov process in (only considering the argument t). This result can be based on 
a basic decomposition, depicted in Figure [TJ 




Figure 1: The basic decomposition for Q'^{t,y). 



Theorem 4.1 (decompositions, independent increments and the Markov property for Q^') The 
limiting random variables X'^'^{t,y), X2^{t,y), X'^'^{t,y) and Q^{t,y) in Theorem 13.21 admit the 
decompositions 

X-''{t2,y) = X^'''{ti,y + t2-ti) + Z^''^{ti,t2,y), for i = 1,2, and t2 > ti > 0, 
X'''-{t2,y) = l'^''-(ti,y + t2-ti) + Z'^''-(ti,t2,y), t2>ti>0, 
Q''(t2,y) = Q''(ti,2/ + t2-ii) + ^"(ti,t2,2/), t2>ti>0, (4.2) 



18 



where y > 0, = Z^'^ + Zg'*" + Z'^'^ , and 

ZY{t^M.V) = r F,'{t + y-s)dA'^{s), 
Jti 

Z'/{h,t2,y) = / / l{s + x>t + y)dK''{a^{s),x), 
Jti Jo 

oo 

Z''^{t^,t2,y) ^ Yl [(^^(^2) - if(ti)) - {Af{t2 - {xi - y)+) - Af{t, - (x, - y)+))] . 

i=l 

If, in addition to the assumptions of Theorem \3.2l the limit process A has independent increments, 
which occurs in the standard case of CoroUaru \'6.1l where A is a BM, then the two random variables 
on the right in (|4.2p are independent in each case. Moreover, the four processes {X^'^ [t, ■) '■ t > 0}, 
{X2^{t, ) : t > 0}, {X'^'^{t, ) : t > 0} and {Q^{t, ) : t > 0} all have independent increments, and 
are thus Markov processes (with respect to the argument t). 

Proof. The decomposition for Xl'^{t,y), X2^{t,y), X'^'^{t,y) and Q^{t,y) in (j4.2p is by direct 
construction, as in Figure [TJ The independent-increments property is inherited from K'^, A^ and 

We now show that the hmit processes are Gaussian if A is Gaussian, which again is the case if 
A is BM. For nonstationary non-Poisson arrival processes (Gj), we can construct such Gt processes 
(or just think of them) by letting the original arrival processes {An{t) : t > 0} be defined by 
An{t) = A{na{t)), t > 0, where A = {A{t) : t > 0} is a rate-1 stationary (or asymptotically 
stationary) stochastic point process, such that A satisfies a FCLT with limit ^y^Ba, where Ba is 
a standard BM. As a consequence, a natural Gaussian limit process is A{t) = ^/^Ba{a{t)), t > 0. 
Indeed, this occurs for the familiar Mt case, for which = 1. 

Theorem 4.2 (Gaussian property) //, in addition to the assumptions of Theorem I3.2|, the limit 
process A is Gaussian, then the limit processes ,Q'^' , D,V'^' in ()3.13p are all continuous 

Gaussian processes. If A{t) = y^Ba{a{t)) for t > 0, where Ba is a standard BM, then for each 
fixed t >0 and y > 0, 

Q'-{t,y) = N{0,al,{t,y)), Q'{t,y) 4 iV(0, ^^(t, y)), W'-{t,y) ^ N{0,al{t,y)), (4.3) 
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where 



= {cl-1) [ F\t + y-sfda{s)+ f F'{t + y - s)da{s), 
Jo Jo 

(cl-l) f F^it- sfda{s)+ f F%t-s)dd{s), 

J t~y J t—y 

cl / / F^i^t + X - s)F''{t + z- s)da{s)dxdz 

Jy Jy Jo 



poo poo pt 

+ / / / F{t + X A z - s)F''{t + xV z - s)dd{s)dxdz. 

Jy Jy Jo 



Proof. It is obvious that the hmit processes are Gaussian when the Hmit arrival process A is 
Gaussian. We only need to derive the variance formulas. We will use (|3.19p to calculate them 
and the mutual independence between the three terms in the expression of gives o"^,,(t,y) = 
al,{t,y) + al^^,{t,y) + al,{t,y), where al^{t,y) = E[{Xl{t,y))% = E[{X'^''' {t,y))^] and 

a^^{t,y) = EKX^itjy))"^]. By Ito's isometry, we have 

c^lrit,y) = cl [ F^{t + y-sfdd{s), 
Jo 

F^{t + y- sfdd{s) + (pdPdA'^ - PdPd,i){d{t) - d{t - {xi - 2/)+)) 



and 



PdPc 



'^PdYPd,iPd,j{a{t) - a{t - {{xi A Xj) - y) + )) 



i<j 



1=1 



'^'^PcPdPd^i / F^{t + y- s)d{a{s) - a{s - {xi - y)^)). 
Jo 



Having X!^'^ well-defined with continuous paths follows from the definition of stochastic integral 



with respect to the Brownian sheet of the first type. It clearly has mean 0. Its variance is given by 



E 
E 



t POD ^ 2- 

/ l{s + x>t + y)dU{d%s),Fcix)) 
Jo 

t POO , 2" 

/ l(s + X > t + y)d{W id'' is), F,{x)) - F,{x)W id" (s), 1)) 
Jo 



rt rOD rt 

= l{s + x>t + y)dFc{x)da''{s)+ F^{t + y - sfda'^is) 

Jo Jo Jo 

-2 1 I l{s + x>t + y)Fcit + y- s)dFc{x)dd''{s) 
Jo Jo 

= [ F,{t + y-s)F',{t + y-s)dd'{s), 
Jo 

where the second equality uses the identity U{x,y) = W{x,y) — yW{x,l), and the third equality 
uses the isometry property of the stochastic integral of the first type with respect to two-parameter 
Brownian sheets and also the isometry property of the stochastic Ito's integral. 
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Notice that 



/ F^{t + y- sfda{s) + [ F,{t + y - s)F^{t + y- s)dcf{s) 
Jo Jo 

I PcF^it + y- s){l - pcF^it + y- s))da(s). 
Jo 



PdP, 

ft 



Moreover, F^ = PcF^+paF^ and FF^ = {l-p,F^-pdF^){p,F^+pdF^) = p,F^{l-p,F^)+pdF^^{l- 
PdF2) — 2pcF^PdF2- Then, simple algebra calculation gives the final expression for <Tg^^{t, y). Similar 
argument applies to the calculation of ag^^{t,y). 

For the variance of W'^{t,y), by the independence of X2^{t,y) and X^{t,y), we have 



E[W'-{t,yf] = E 



Xl{t,x)dx 



+ E 



X2^{t, x)dx 



E 



Xl{t,x)dx 



Then by an analogous argument, we obtain the variance of W'^{t,y). ■ 

We remark that, for Theorem 14. 21 we could also have used an argument analogous to Lemma 5.1 
in [27j by understanding the integral in X2' as a mean-square limit ( §6.31) . However, our approach 
here by applying properties of stochastic integrals of the first type with respect to two-parameter 
Brownian sheets simplifies the proof. Paralleling the result in Lemma 5.1 ^27j, we can easily check 
that for < i < t', < y < y', 

E[{Xr{t,y)-Xrit',y')f] 

= [ {Fc{t' + y'-u)- F^{t + y-u)){l + F^{t + y - u) - F^{t' + y' - u))dd^{u). 
Jo 

Corollary 4.1 [the special case = 1) If, in addition to the assumptions of Theorem 4-2< d{t) = 
Jq X{s)ds and = 1, then 



Var{Q^{t,y)) 



F%t + y -u)\{s)ds, 



(4.4) 



for t > and y > 0. The limit A and all the other limits are the same as if the unsealed arrival 
processes : t > 0} are Poisson processes {possibly nonhomogeneous) . {When An is Poisson, 

the prelimit variables Q'^{t,y) and Q^{t,y) are Poisson random variables for each t and y.) More- 
over, as in the Poisson arrival case, for each i > and y >0, Q^{t,y) is distributed the same as 
the limit of 

(4.5) 



Q;(t,y) = m{t,y)-f{t,y)), 

i=l 

where {r]i{t,y) : i > 1} is a sequence of i.i.d. Bernoulli random variables with 

P{r^,{t,y) = l) = P'{t,y), 
which are independent of the total queue length Qn{t). 



(4.6) 
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Proof. We need to justify (j4.5p . First, we note that this is the asymptotic generahzation of an 
exact relation for Poisson arrivals; e.g., see Theorem 2.1 of [15]. Here we start by defining 

Qi(t) 

Ql(t,y)^ Vi{t,y), 

i=l 

for each t > and y > 0. (In passing, we remark that Qn{t,y) = Qnit,y) in the special case of a 
nonhomogeneous (M^) arrival process, but not more generally.) By the FWLLN, the fluid scaled 
processes Q.nit,y) converge to the fluid limit (f{t,y) as n — )• oo: 

Q'nit,y) Q'it,y) ^ EMt,y)]q\t) = r%t,y)q\t) = ^Y^q\t) = fit,y). 

We can write Qn{t,y) in ()4.5p as 

nQiit) 



1 •■•^iv-/ 

Q;(t,y) = ^ Yl {m{t,y)-r'%t,y)) + r%t,y)Q\ 



it). 



By FCLT for random walks with i.i.d. increments of mean and finite variance (Theorem 8.2, [2j), 
continuity of composition in D (Theorem 13.2.2, [38]) and Theorems 13.11 and 13. 2^ we obtain the 
weak convergence of QJ^(t,y): 

Qnit,y) ^ Q''{t,y) in Dd as n^oo, 

where 

Q'{t,y) = as{t,y)B3{q\t)) + mt,y)Q\t) 

where al{t,y) = f^''^{t,y){l — f^'^{t,y)) and is a standard Brownian motion, independent of 
Q^(t). Thus, Q^{t,y) is Gaussian with mean and variance 

Var{Q^{t,y)) = al{t,y)q\t) + r%t,yfVar{Q\t)) 

= r'{t,y){l- mt,y))q\t) + r'^it^y f f F'^{t-u)\{s)ds 

Jo 

t 



= f{t,y)= F'{t + y-u)X{s)ds = Var{Q^{t,y)). 
Jo 

Since Q'"(t, y) and (5'"(t, y) are both Gaussian with the same mean and variance, QJ'it, y) and Q^{t, y) 
are equal in distribution. When the arrival process is Mt, (5^(t,y) has a Poisson distribution for 
each n, t and y, so that the variance equals the mean. Since = 1, the limit must be the same 
here as in the Mt case. ■ 
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We emphasize that Corollary 14.11 is consistent with known results for the Mf/GI /oo model. 
The asymptotic equivalence to the random sum in (14. 5|) and (14. Gh is the asymptotic analog of the 
property for the Mt/GI/oo model that, conditional on the number of customers in the system, 
the remaining service times are distributed as i.i.d. random variables with c.d.f. f^''^{t, •); e.g., see 
Theorem 2.1 of [TJ]. This property does not hold for ^ 1. 

Corollary 4.2 {the standard case) If a{t) = Xt and A = \J Xc^Ba, then the variances of Q^{t,y) 
and Q'^{t, y) are 

al,{t, y) = X{cl - 1) /* F^{y + s fds + X f F^{y + s)ds 

Jo Jo 

/oo fOO 
F^isfds + X F''{s)ds = al^iy) as t ^ oo, y > 0, 

and 

(^le{t,y) = X{cl-l) r F'{sfds + X r F\s)ds = al,{y), t,y>Q. 

Jo Jo 

Thus, Q^{t,y) =^ N{0,ag ,^{y)) and Q^{t,y) =^ A^(0, 0"^ g(y)) as t ^ oo. //, in addition, = 1, then 
al^{t,y) = X F''{y + s)ds^X F''{s)ds = -F;:{y), as t ^ oo, y>0, 

Jo Jy M 

<^le{t,y) = X r F\s)ds = -Fe{y), t,y>0, 
^ Jo 

and Var{Q''{t)) = X F'^{s)ds — )> A//i as t ^ oo. 

5 Initial Conditions 

So far, we considered only new arrivals. Now we consider customers in the system initially. Like 
the generality of the service-time c.d.f., the initial conditions present technical difficulties. Our 
assumptions will be similar to those made in [27] and to those for the new arrivals in ^ However, 
these assumptions are less realistic here. Thus, for applications, it is good that the relevance of 
the initial conditions decreases as time evolves, because we can think of the system starting in 
the distant past with just new arrivals, so that we will be able to approximate the two-parameter 
processes by the Markov limit processes. 

We assume that the remaining service times of the customers initially in the system are i.i.d., 
distributed according to some new c.d.f., independent of the number of customers in the system and 
everything associated with new arrivals. That rather strong assumption will actually be justified 
if we assume that the initial state we see is the result of an Mt/GI/oo system, possible with 
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different model parameters, that started empty at some previous time. As noted in Corollary 
14.11 and the remark before Corollary 14.21 this strong independence property actually holds in an 
Mt/GI /oo model. Moreover, that representation is asymptotically correct more generally if = 1. 
Unfortunately, however, that representation is not asymptotically correct if 7^ 1. Nevertheless, 
it is a natural candidate approximate initial condition. 

Here is our specific framework: Let Qlf{y) be the number of customers initially in the n^^ 
system at time 0, not counting new arrivals, who have residual service times strictly greater than 
y. Let Qn* = Qn (0) be the total number of customers initially in the n*^ system and let Qlfiy) 
be the number of customers initially in the n^^ system that have elapsed service times less than or 
equal to y. Let Wn'"{y) and W^'* be the corresponding workload processes, defined as in (|2.2ip . 

Let Qlfiy) and Qri {y) be the associated scaled processes, defined by 

Q'^'iy)^^^ and = V^(Qr(y)-r(y)), y>o, (s.i) 

n 

where g*''' is the FWLLN limit of Q]f to be proved. Let other scaled processes be defined similarly. 
What we need are the FWLLN Qn'' =^ (t'^ and the associated FCLT Qri =^ Q*'*" in D as n — >■ 00, 
jointly with the limits in Theorem 13. 2[ The extension to joint convergence with the other processes 
will be immediate if the stochastic processes associated with new arrivals are independent of the 
initial conditions. Otherwise, we require that we have the joint convergence (A„,Qn'^) =^ (^jQ*'*^) 
in D X D, with the service times of new arrivals coming from a sequence of i.i.d. random variables, 
which is independent of both the arrival processes and the initial conditions. We now give sufficient 
conditions to get these limits. 

Assumptions for the Initial Conditions. 

Assumption 3: i.i.d. service times. The service times of customers initially in the system 
come from a sequence {r/j : j > 1} of i.i.d. nonnegative random variables with a general c.d.f. Fi 
and -Fi(O) = 0, independent of n and independent of the total number of customers initially present 
and all random quantities associated with new arrivals. ■ 

Assumption 4: independence and CLT for the initial number. The initial total number 
of customers in the system, , is independent of the service times of the initial customers and 
all random quantities associated with new arrivals. There exist (i) a nonnegative constant g*'* and 
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(ii) a random variable Q*' such that 



Qil* = ^{Qif - nt^) ^ Q'^* in M as n ^ oo. ■ (5.2) 



Parahehng Lemma l2.lt we have the representation result. 
Lemma 5.1 (representation of Qll^) The process Qll'" can be represented as 

Qn 

Qlfiy) = Y,{lirj)>y)-F,^iy))+Q'^Friy), y > 0. (5.3) 

Theorem 5.1 (FWLLN and FCLT for the initial conditions) Under Assumptions 3 and 4, 

Qlfiy) (t''{y) = Ff{y)cf'' m D as n ^ oo, (5.4) 

Qji^(y) Q''^{y)^F[iy)Q''' + y^tB%Fi{y)) m D as n ^ oo, 



where is a Brownian bridge, independent of Q 



We can combine Theorems 13 . H [3^2] and ISTTl to treat the total number of customers in the system 
time t with residu 
key representation is 



at time t with residual service times strictly greater than y, which we denote by Qn'^{t,y). The 



Ql'''(.t,y) = Q:,{t,y) + Q'''{t + y), t>0, y > 0. (5.5) 
Corollary 5.1 (FWLLN and FCLT for all customers) Under Assumptions 1 — 4, 
Ql^'{t,y) EE Qif{t + y) + Ql{t,y)^f^^t,y)^q''^{t + y) + f{t,y) 



= F[{t + y)if'' + r F%t + y-s) da{s), 
Jo 

Ql'it^y) ^ Q^{t + y) + Q'n{t,y)^Q"'^'{t,y)^Q'^'^{t + y)+Q'{t,y) 



(5.6) 



= F^{t + y)Q''' + VW'B\Fi{t + y)) + 1^ v) + X'/{t, y) + X^''^(t, y), 
in Do as n —)• oo, where X'^'^ , X^"^ and X*^'^ are given in (j3.16p . 

6 Proof of the FCLT 

We now prove the FCLT in Theorem 13. 2i First, the joint convergence of the processes 

(i„, i;;, At {il, : i > 1}) ^ (i, i^ i", {if : i > 1}) 



follows from Theorem 9.5.1 in |48| . For the subsystem with discrete service-time distribution, the 
limits follow from an easy extension of [TJj. In [l3|, the convergence to the limit X'^''^{t, y) is proved 
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in the space D for each fixed y > 0, however, the convergence can be easily generahzed to be in the 
space Dd since the limit process A is assumed to be continuous here (Assumption 1). Since the 
prehmit process of X'^'^ is 

oo 
1=1 

it suffices to show that the mapping (j) : D ^ Do defined by 

oo 

</>(z)(t,y) = - <^ - (^i - V)^) 

2=1 

is continuous in the Skorohod Ji topology and then apply the continuous mapping theorem. More- 
over, in order to prove Wn'^{t,y) =^ W'^''^{t,y) in Do, where Wn'^{t,y) can be written as 

W:^'\t,y) = Y, r\AiM-Ki^t-{x,-x)+))dx, t,y>0, 

i=i -^y 

we need to prove the continuity of the mapping ij) : D ^ Dq defined by 

^{z){t,y)= {z{t)-z{t-{xi-x)+))dx, z£D, t,y>0. 
Jy 

Since the limit A is continuous, it suffices to show the uniform continuity of the mapping ip on 
compact intervals, which follows from a direct argument. Thus, we will only focus on the subsystem 
with continuous service-time distributions. For notational convenience, we will simply suppose that 
F in Assumption 2 is continuous such that Fc = F, A^ = An and similarly for other processes. In 
particular, we write X"^'^ and X!^'^ simply as Xi and X2, respectively. 

One might hope to obtain a very fast proof by applying the continuous mapping theorem with 
an appropriate continuous mapping. That would seem to be possible, because both the initial 
stochastic integral in (|2.1U|) and the representation in Lemma 12.11 show that the scaled residual 
service queue-length process Q^^ can be regarded as the image of a deterministic function h : D x 

—7- Dd mapping Kn) into Q^. Given that {An, Kn) =^ {A, K) under Assumptions 1 and 2, 
we would expect that corresponding limits for Q'[^ and the other processes would follow directly from 
an appropriate continuous mapping theorem. Unfortunately, the connecting map is complicated, 
being in the form of a stochastic integral, with the limit of the component Xn,2 involving a two- 
dimensional stochastic integral. In fact, we will show below that we can easily treat the component 
Xn,i via the representation (j3.21|) . However, Xn^2 presents a problem. Unfortunately, the general 
results of weak convergence of stochastic integrals and differential equations in |28^ [HTj [29] does not 
seem to apply. Thus, instead, we will follow [27] and prove the convergence in the classical way, by 
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proving tightness and convergence of the finite-dimensional distributions. (See [H] for a different 
way.) 

For us, the first step is to get convergence for the process Rn jointly with {An.,Kn) by exploiting 
the composition map for a random time change, paralleling §13.2 of |48] : see [S] for extensions 
to Dr). Starting from =^ {A,K), we first obtain =^ {A,a,K) by applying 

(j2.ip and Theorem 11.4.5 of [48j. We then apply the continuous mapping theorem for composition 
applied in the space Dq, where the composition is with respect to the first component of Kn, and 
the limit a and K are both continuous (in the first component for K). That yields 

{An,An,kn.Rn)^{A,a,k,R) in D^xDl, (6.1) 

where R{t,x) = K{a{t),x) = U{a{t),F{x)) for t > and x > 0. Since R does not involve A, we 
see that An and Rn are asymptotically independent. Necessarily, then the processes Xn^i and Xn.2 
are asymptotically independent as well. 

We use the classical method for establishing the limit 

{An,An,kn,Rn,Xn,l,Xn,2) {A, a, K , R, X^ , X2) (6.2) 

m D"^ X D%: We show convergence of the finite-dimensional distributions and tightness. We 
get tightness for {{An, An, Kn, Rn) : n > 1} from the convergence in (j6.ip . We use the fact that 
tightness on product spaces is equivalent to tightness on each of the component spaces; see Theorem 
11.6.7 of [48j. Since we can write Xn^i as (j3.2ip . the tightness and convergence of Xn.i =^ Xi in 
Dz) can be obtained directly by applying continuous mapping theorem if we can prove the mapping 
defined in (j3.2ip from A„ to Xn,i is continuous in D^- We will prove the continuity of this 
mapping in in ^6.1[ We then establish tightness for {(X„^i,X„^2) : > 1} in ^6.21 and the 
required convergence of the finite-dimensional distributions associated with {{Xn^i, Xn,2) ■ n > 1} 
in §6.31 Given the limit in ()6.2|) . the rest of the limits in parts (a) and (6) follows from the 
continuous mapping theorem. The limit in part (c) is an application of convergence preservation 
for composition with linear centering as in Corollary 13.3.2 of [48j. The component limits require 
finite second moments. 

6.1 Continuity of the Representation for X„ i in 

In this section, we prove the continuity of the mapping (j) : D ^ Do defined by 

<l){x){t,y) = F''{y)x{t)- I x{s-)dF{t + y - s), (6.3) 

Jo 
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for X G and t,y > 0. By l^lT\i and ([3l^ . we have = and = 

<P{A){t,y). 

Lemma 6.1 The mapping (p defined in is continuous in Dd. 

Proof. Suppose that x„ — )• x in D. We need to show that (j){x)) — )• as n — )• oo. Let 

T > be a continuity point of x and consider the time domain [0, T] x [0, oo). By the convergence 
a;„ — 7- x in {D,Ji) as n — t- oo, there exist increasing homeomorphisms A„ of the interval [0,T] 
such that \\xn — x o A„||t — ^ and \\Xn — ^Wt — as n — ?• oo, where e{t) = t for ah t > and 
\\y\\T = sup^g[o,T] \yi't)\ for any y £ D. Let M = supo<j<2- I^^IOI < c«. Since F is continuous, it 
suffices to show that 



Now, we have 



Mxn)i-r)-mM),' 



sup \(j){xn){t,y) - (j){x){Xnit),y)\ ^ 0, as n oo. 

(t,3/)G[0,T]x[0,oo) 



){t,y)-cl){x){Xnit),y)\ 

= F^{y)xn{t)- I Xn{s-)dF{t + y- s) 
Jo 

rXnit) 

- F\y)x{\n{t)) + / x{s-)dF{Xn{t) +y-s) 
Jo 

< -x(A„(t))| 



+ 



/ Xn{s-)dF{t + y-s)- / x{s-)dF{Xn{t) + 
Jo Jo 



y-s) 



F'{y)\xn{t) - x{Xn{t)) 

+ 



/ Xn{s-)dF{t + y-s)- f x{Xn{s)-)dF{Xn{t) + y-Xn{s)) 
Jo Jo 



< F%y)\xn{t) - xiXnit))\ + / {xnis-)-x{Xn{s)-))dF{t + y-s) 

Jo 

ft 



+ 



x(A„(s)-)d(F(A„(t) +y- Xn{s)) -F{t + y- s)) 







< F%y)\xn{t) - x{Xn{t))\ + ||x„ - X o Xn\\T\F{y) - F{t + y)\ 
+ M\F{Xn{t) + y)-F{t + y)\ 

< 3\\xn-xo Xn\\T + M\F{Xn{t) + y)-F{t + y)\. 

The third term in the third inequahty follows from the uniform continuity of the integrator because 
F is continuous, monotone and bounded. By taking the supremum over {t,y) G [0,T] x [0,oo), the 
first term converges to by the convergence of x„ — )• x in D, and the second term converges to 
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by the uniform convergence of A„ — t- e in [0,T] and the continuity of F. This imphes the initial 
convergence to be shown, so that the mapping : D — t- Dd is indeed continuous. ■ 

6.2 Tightness 

In this section, we estabhsh tightness for the sequence of scaled processes in (j3.13p . It suffices 
to prove tightness of the sequences of processes {Xn^i : n > 1} and {^n,2 : n > 1} in Dij. By 
Assumption 1, the sequence of processes {A^ : n > 1} is tight. The tightness of {X„ i} follows 
from the continuity of the mapping (p in Dd. It remains to show the tightness of {Xn,2} and then 
we obtain tightness of the sequences of processes {Ql^ : n > 1} and {QJ^ : n > 1} using the fact 
that tightness of product spaces is equivalent to the tightness on each of the component spaces. 

Theorem 6.1 Under Assumptions 1 and 2 [F is continuous), the sequence of processes {Xn^i '■ 
n > 1}, {Xn^2 '■ n > 1}, {Qn '■ n> 1} and {Q^ '■ n > 1} are individually and jointly tight. 

In order to prove the tightness of {^n,2 : n > 1} defined in (j2.14p . we will closely follow the 
approach in [27], but we must adjust to the tightness criteria in Do. The following tightness criteria 
are adapted io Do from Theorem 3.8.6 of Ethier and Kurtz [11]. For a review of tightness criteria 
for processes in the space D, see [50] . 

Theorem 6.2 A sequence of stochastic processes {X^ : n > 1} in Do is tight if and only if 

(i) the sequence {X^ : n > 1} is stochastically hounded in Do, i-e., for all e > 0, there exists a 
compact subset K such that 

P(||X„||t G i^) > 1 - e, for ah n > 1, 

where \\Xn\\T = sup^g[o,T]{suptg[o,T] \Xn{s,t)\}; 
and any one of the following 

(a) For all 5 > 0, and all uniformly bounded sequences {t„ : n > 1} where for each n, Tn 
is a stopping time with respect to the natural filtration F„ = € [0, T]} where Fn{t) = 

a{Xn{s, •) : < s < t}, there exists a constant /3 > such that 

limlimsupsup£^[(l A dj^{Xn{Tn + 5, ■),Xn{Tn, = 0; 

or 

(ii') For all 5 > 0, there exist a constant (3 and random variables 7n(5) > such that for each 
n, w.p.l, 

E[{1 A dj, {Xn{s + U, ■),Xn{s, -WlTnKl A dj,{Xn{s - V, ■),Xn{s, < E[-fn{6)\Fn], 
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for all < s < T, < u < 6 and < V < s A 6, where F„ = {J^n{t) : t G [0,r]} with 
J=-^{t) = a{Xn{s, ■) ■.0<s<t} and 

limlimsup£^[7n((5)] = 0. 

Remark 6.1 The following condition is sufficient, but not necessary, for condition (ii) in Theorem 

[Ql - 

For all 5n i and for all uniformly bounded sequences {t„ : n > 1}, where for each n, Tn 
is a stopping time with respect to the natural filtration F„ = {J-n{t) ■ t S [0,r]} with J-n{t) = 
a{Xn{s,-) ■.0<s<t}, 

djj^{XniTn + 6nr),Xn{Tn,-)) =^ 0, aS n OO. 

We will also need to generalize the tightness criteria in Lemma VI. 3. 32 in |22] for processes in 
the space D to those in the space Dd as in the following lemma, and its proof also follows from 
that in |22j with inequalities for the modulus of continuity for functions in the space Dd- 

Lemma 6.2 Suppose that a sequence of processes {X„ : n > 1} in the space Do can be decomposed 
into two sequences {Yn : n > 1} and {Zn : n > 1} for some parameter g G N, i.e., X„ = Yn + Zn 
for each n>l, and that (i) the sequence {Yn : n > 1} is tight in the space Do and (ii) for allT > 
and 5 > 0, lim^^oo 1™ sup„_j.oj3 P(sup^ y<j^ \ Zn{t, y)\ > 6) = 0. Then, the sequence {X„ : n > 1} is 
tight in the space Do- 

We first give a decomposition of the process Xn^2 for each n. Following [27], we can write 
Rn(t,y) in (I2J6I1 as 

Rn{t,y) = - r ^^^^^dF{x)+Ut,y), 
Jo J- — [x) 

where 

We remark that we need not consider the left-hand limit of i?„, in the second argument, as was 
done in [27], since the service-time c.d.f F is assumed to be continuous, while F is allowed to be 
discontinuous in [J^. Hence, X^^i can be written as 

^n,2(t,y) = Gn(t,y)+^n(i,y), for i>0 and y > 0, (6.4) 
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where 

ft POO 



Gnit,y) ^ [ ri{s + x<t + y)d( - r f dF{v) 
Jo Jo ^ Jo 1 - F{v) 

Rn{t + y-x,x) 







1 - F(x) 



dF{x), (6.5) 



and 

ft />oo 



Hn{t,y)= / / l{s + x<t + y)dLn{s,x). (6.6) 
Jo Jo 

Thus, the tightness of {Xn,2} fohows from the tightness of {Gn} and {Hn}- We wih establish their 
tightness in the following two lemmas. 

Lemma 6.3 Under Assumptions 1 and 2 {F is continuous), the sequence of processes {Gn : n > 
1} = {{G„(t,y) : t > 0,y > 0},n > 1} is tight in the space Df). 

Proof. We will apply Lemma |6.2[ We define the sequence of processes {G^ ■ n > 1}, for some 
eG (0,1), by 

y)^- fj' t ^^J' l{F{x) < 1 - e)dF{x), t,y>0. (6.7) 
We will prove that {G^ : n> 1} is tight m. Dq and 

limlimsupPf sup f^^ ^"^^ + y - x x) ^ ^ _ ^^^^^^^ > s) = 0, (6.8) 

40 n ^t,y<T Jo I - F{x) / 

for each 6 > and T > 0, and thus will conclude that the sequence {G„} is tight in by Lemma 
16. 2[ It is easy to see that (j6.8p follows easily from (3.23) in [27J. So we only need to prove the 
tightness of the sequence of processes {G*^ : n > 1}. 

Recah that Rn{t + y-x,x) = Un{An{t + y - x) , F (x)) . By ([2J]) and [/„ =^ [/ in ([23]) as n oo, 
and by applying the continuous mapping theorem to the composition map of Un with respect to 
the first argument (Theorem 13.2.2, ^48j), we obtain 

Rn{t + y-x,x) = UniAn{t + y-x),F{x))^U{d{t + y-x),F{x)) in Dd, 

as n — )• oo. The weak convergence of {Rn : n > 1} in Dd implies that : n > 1} is stochastically 
bounded, so the integral representation of G^ in terms of Rn in ()6.7p implies that {G^ : n > 1} is 
also stochastically bounded in Du. We apply Theorem 16.21 to prove the tightness of {G^ : n > 1} 
in D£). In this case, it is convenient to use the sufficient criterion in the remark right after Theorem 
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Let Gn = {Gnit) -tG [0,T]} be a filtration defined by 



Gn{t) = a{Rn{s,-):0<s<t}vM 

= cr{r]i <x:l<i< An{t),x > 0} V a{An{s) : < s < t} V A/", 

wliere M includes all the null sets. Note that the filtration G„ satisfies the usual conditions 
(Chapter 1, |24j and proof of Lemma 3.1 in [27J). Let 6n i and {t„ : n > 1} be a uniformly 
bounded sequence, where for each n, r„ is a stopping times with respect to the filtration G„. Then, 
it suffices to show that 



dj^{Gl^{Tn + 6n,-),GliTn,-)) =^ 0, as n oo. 

Consider any sequence of nondecreasing homeomorphism {A„ : n > 1} on [0, T] such that lim„,_j>oo ^n{y) 
y uniformly in y G [0,T]. We want to show that the following holds: 



sup 

o<y<T 



0, as n — >• CO. 



Now, 



sup 



0<y<T 




sup 

0<y<T 


I 


f-T, 


+y 


Jo 




sup 

0<y<T 


I 


+ sup 

0<y<T 


j-Tn+y 












1 - F{x) 
-l(F(x) < 1 - e)dF{x 



l{F{x) < 1 - e)dF{x) 



1 - F{x) 

rn+5„+Xn{y) ^^(^^ + + Xn{y) - X, X) - Rn{Tn + y-X,x) 



1 - F(x) 



1 - F{x) 
-l(F(x) < 1 - e)dF{x 



1 - F(x) 
l(F(x) < 1 - e)dF{x) 



l(F(x) < 1 - e)dF{x] 



as n — )• oo, where the first and the second terms converge to by the stochastic boundedness 
and weak convergence of i?„ in Du, and because r„ is uniformly bounded, A„(y) converges to y 
uniformly in [0, T], and 6n i as n ^ oo. Hence, the processes {G^} are tight in Do and the proof 
is completed. ■ 

Lemma 6.4 Under Assumptions 1 and 2 {F is continuous), the sequence of processes {Hn : n > 
1} = {{Hn{t,y) : t > 0,y > 0},n > 1} is tight in Do- 
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Proof. As in Lemma 3.7 in [2^, we write the process if„ as 

We will apply Theorem 16.21 to prove the tightness of {Hn : n > 1} in Dd- In this case, it is 
convenient to use criterion {ii) in Theorem 16. 2[ We will first prove that this criterion holds, and 
then prove the stochastic boundedness of the sequence of processes {Hn : n>l}. 
Let H„ = {Hn{t) '■ t £ [0,T]} be a filtration defined by 

Tinit) = a{Hn{s,-)-0<s<t}\/Af 

= (y{r]i <s + x-rf:l<i< An{t),x > 0,0 < s < t} V {An{s) : < s < t} VA^, 

where N includes all the null sets. The filtration H^i satisfies the usual conditions (see p. 254 in 
[27j). 

Let 5 > Q and {k„ : n > 1} be a uniformly bounded sequence, where for each n, is a stopping 
time with respect to the filtration H„. It suffices to show that 

limlimsupsup£'[dji(if„(K„ + (5, •),i?„(K„, O)^] =0. (6.9) 

04-0 71— >00 K„ 



Consider any sequence of nondecreasing homeomorphism {A^ : n > 1} on [0, T] such that 
lim„_^cx) ^n{y) = y uniformly in y G [0, T]. We want to show that the following holds: 

Hn{l<-n K{y)) - Hn{Kri,y)\ \ 

Define the processes Hn,i = {Hn^i{t,y) : t,y > 0} hy 



lim lim sup sup E 



( sup \Hn{Kn+S,Xn{y)) - Hn{Kn,y)\) ] =0. (6.10) 



Ka^t, y) = 1(0 <r],<t + y-Tn- I ^dF{u). 



1 - Hn) 

As in Lemma 3.5 in [27], one can check that for each fixed y and for each i, the process 
{Hn,i{t,y) : t > 0} is a square integrable martingale with respect to the filtration H„ and it has 
predictable quadratic variation 

{Hn,i{-,y)){t) = {Hn,i){t,y) = / ^^dF{u), for t > 0, 

and that the H„ martingales Hn,i{-,y) and Hnj{-,y) for each fixed y are orthogonal for i ^ j. 
Thus, for each fixed y and constant K > 0, the process Hn = {Hn {t,y) : t > 0} defined by 

Hf\t,y) = ^ E (l(0<r?.<t + y-rr)-y^ T3^^^(^))' 
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is an H„ square integrable martingale with predictable quadratic variation 



for t > 0. By the SLLN 

- r ^-^dF{u) ^ t 



1 - F(u 



-dF{u) 



lnt\ 



a.s. as n — )■ oo. 
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So for each fixed y, the sequence of quadratic variations {{H^\-,y)) : n > 1} is C-tight by the 
continuity of a (Recall that a sequence {1^} is said to be C-tight if it is tight and the limit of any 
convergent subsequence must have continuous sample paths.). It follows by Theorem 3.6 in [50j 
that the sequence {Hr!^\-,y) : n > 1} is C-tight for each fixed y. 
Now, to prove (j6.10p . we have 

E ( sup \Hri{Kn+ 5,\n{y)) - Hn{K.n,y)\] 
^^0<y<T ' -I 

< 2E sup A„(y)) -i?„(K;n,A„(y))| 

o<i/<r 



sup i?„(K„, A„(y)) - i7„(K„,y) 

0<J/<T' 



2 Mm E 



+2 lim E 



sup \Hf \Kn + 5An{y)) " H^^K^n An{v))\ 

o<y<T 

2 



sup \Hf\Kn,Xn{y)) - Hf\>^n,y)\ 



where the equality holds by the dominated convergence and by stochastic boundedness of A„ . The 
first term converges to as n — )• oo and 6 10 hy the assumptions on «;„ and and C-tightness of 
{H^^ : n > 1}. We conclude that the second term converges to by observing 



Hf\Kn,\n{y))-Hf\Kn,y) 

77^ {M^<m<^^n + Xn{y)-T]^)-^0<r]i<Kn + y-Tl 

1=1 



1 



f7yiA{K„+A„(y)-r^")+ 

/o l-F(n) 
Thus we obtain (l630]) . 



dF{u) 



1 - F{u) 



dF{u))). 



Now we prove the stochastic boundedness of {Hn : n > 1} in D^. We observe that for each n, 
each sample path of the process Hn is bounded by that of the process Hn defined by 



dF{u) 
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The stochastic boundedness of {Hn : n > 1} m follows directly from the proof of Lemma 3.7 
in [27|. Therefore, {Hn : n > 1} is stochastically bounded, so that tightness of {Hn : n > 1} in Dd 
is proved. ■ 

6.3 Convergence of the Finite-Dimensional Distributions 

In this section, we complete the proof of the convergence {Xn,i, Xn^2) =^ iXi,X2) in D/j x Dd by 
proving that the finite-dimensional distributions of {Xn,i, Xn,2) converge to those of {Xi,X2) since 
we have proved the tightness of {{Xn,i, Xn,2) : n > 1} in ^6.2[ We will mostly have to deal with 
Xn,2, since we have already shown convergence of Xn^i- Our argument for Xn,2 will also enable us 
to establish joint convergence of the two finite-dimensional distributions. 

Lemma 6.5 Under Assumptions 1 and 2 {F is continuous), the finite- dimensional distributions of 
{Xn,i, Xn,2) converge to those of {Xi,X2) as n ^ oo. 

Proof. First of all, we understand the integrals X„ 2 in (|2.14p and X2 (= ^2'^) in (j3.16p as 
mean-square integrals, so that they can be represented as 

Xn,2{t,y) = l.i.m.k^ooXn,2,k(t,y), and X2{t,y) = l.i.m.fe_^oo-^2,fc(i, y), 
where l.i.m. means limit in mean square, that is, 

lim E[{Xn,2it,y)-Xn,2,k{t,y)f] = and lim E[{X2{t,y) - X2,k{i^y)f] = 0> 

Xn,2,k{tyy) 

and 

X2,k{t,y) 
where 1^ ^ is defined by 



t fOO 



JO 

k 



ll^{s,x)dUn{An{s),F{x)) 



[a^„ {Anisl,),Anis'l),0, F{t + y- s'l)) 



i=l 



t roo 



JO 
k 



lUs,x)dUia{s),F{x)) 



Y,[Au{a{sl,),a{s'^),0,F{t + y-s'^)) 



i=l 



0)l(x < t + y) + 5^ l(s G (sti, s^])l{x <t + y- s'l), (6.12 



i=l 
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with the points = Sq < < ... < = t chosen so that maxi<j<fc \sf_i — | — )• as /c — )• oo, and 
Ajj and Au are defined as in (14. ip . 

We prove the convergence of the finite-dimensional distributions of Xn,2 to those of X2 by taking 
advantage of the convergence of C/„ C/ as n — )• 00 in D{[0, oo),D([0, (see (j2.5p ). for which 
we define another process {Xn^2,k{'t,y) '■ t,y > 0} in Dd for each n by replacing the terms in 
Afj of Xn 2 A; by a as follows, 

ft fOO 

Xnxkit.y) = - litis, x)dUn{a{s),F{x)) 

Jo Jo 

k 
i=l 

Hence, we easily obtain the convergence of the finite-dimensional distributions of Xn,2,k to those 
of X2^k as n — )• 00, since a and F are both continuous by Assumptions 1 and 2, and the finite- 
dimensional distributions of Un converge to those of f7 as n — t- 00 and U is continuous. 

Moreover, since Kn (Un) and A„ are independent by Assumptions 1 and 2, Xn^2,k and Xn^i 
are independent, and since the limit processes X2^k and Xi are also independent, we obtain the 
joint convergence of the finite-dimensional distributions of (^n,i, ^n,2,fc) to those of {Xi,X2,k) as 
n — )• 00. 

Now it suffices to show that the difference between Xn,2.k and Xn.2,k is asymptotically negligible 
in probability as n — )• 00, and the difference between Xn,2 and Xn,2,k is is asymptotically negligible 
in probability as n — )■ 00 and A; — t- 00, i.e., 

lim P( sup |l„.2,fc(t, y) - Xn^t, y)| > e) = 0, T > 0, e > 0. (6.13) 

n^oo \0<t<T,y>0 ' ' 

and 

lim limsupP(|l„,2,fc(t,y)-X„,2(t,y)| >e) = 0, t, y > 0, e > 0. (6.14) 

We obtain (|6.13p easily from Assumption 1 and (j2.5p since a and U are continuous. Now we 
proceed to prove ()6.14p . We will follow a martingale approach argument similar to the one used in 
Lemma 5.3 of [27], which relies on their technical Lemma 5.2. Fortunately, for our two-parameter 
processes, the conditions of Lemma 5.2 [27] are satisfied by fixing the second argument. We have 
for t, y > and T > 0, 

P{\Xn:i,k{t.y) - K,2{t.y)\ > e) 

< P(A„(t) > T) + P(|X„,2,fe(t, y) - Xn,2{t, y)\>€, Anit) < T). (6.15) 
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On {Anit) < T}, 



a CO 



(1^ x)-l{s + x<t + y))dUn{An{s), F{x)) 



A„(t)A(nT) 



where 



-{Fit + y-rn-Fit + y-s';))). 
Define the process Z„ = {ZA {t,y) : t,y > 0} hy 

A„(t)A(nT) 

E (3i{rr,m)it,y), t,y>o. 

i=l 

As in Lemma 5.2 in ^27j, one can check that for each fixed y > 0, the process Zn (•,?/) = {Zn {t, y) : 
t > 0} is a square integrable martingale with respect to the filtration F„ = {Tn{t).,t > 0}, where 

= (T{r/i < s + x : 1 < i < A„(t),x > 0,0 < s < t} V {yl„(s) : < s < t} V TV, 
fx) 

and the quadratic variation of Zn (-,2/) is 

A"(i)A(nT) 

{Z^:^\-:V)){t) = {Z^P){t,y) = E EW^ir^,V^){t,y?] 

i=l 

A"{t)A{nT) k 

i=i j=i 
.il-iF{t + y-rn-F{t + y-s';))) 

A"{t)A{nr) k 

^ E E < ^" ^ + y - rf) - F(t + y - s';)) 
i=i j=i 

k 

= + y - -F{t + y- - ^n(s^i)) 

< sup -^n(4-l)}, 
l<j<fc 

where the last inequality follows from the fact that the sum of the coefficients before the An{Sj] 
An{Sj_i) terms is less than 1. So for fixed y > 0, and on {A^^t) < T}, 

lim limsupS[(X„,2(i,y) - Xn,2,ki^,y))'^] = lim limsupE' 

k^oo n->co fc->co n->-oo 



{^zPi.,y))it) 



< lim lim sup E 



sup 

l<j<k 



0, 
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where the convergence to holds because of the continuity of a, Assumption 1 and maxi<j<fc(s^ 
Sj_i) — ;> as /c — )• oo. 
Hence, (I6.15j) becomes 

P{\Xn,2,k{t^y)-Xn,2{t,y)\>e) < PiAn{t)>T) + ^E\{^ZPi;y)){t) 



< P{An{t) > T) + sup - i„(4_i)} 

e k<i<fc 

Therefore, by the stochastic boundedness of An, (|6.14p is proved. That concludes the demon- 
stration that the finite-dimensional distributions of (^n,i)^n,2) converge to those of {Xi,X2) as 
n — )• oo. ■ 
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